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ABSTRACT 

1., 4- ^ ^ V"^ FORCAST readability index was developed and cross 
validated on technical job reading materials and job candidates. 

passages were related to passage 
readability defined as the lowest measured reading grade level at 
which half the readers met a standard cloze criterion on the passage. 
The simple, single variable FORCAST Index correlates .9 with the 
Flesch and Dale-Chall Indices, has a cross-validity of .8 with the 
cloze criterion, and yields an average absolute error about half that 
of the two standard general readability indices studied. (Author) 
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PROBLEM 

For some time we have been engaged In a program of research to 
determine the^t eracy aklll requi rements of Army Jobs. One of our 
approaches has been to Investigate the readability of printed materials 
used In the training for and performance of these jobs. 

Readability Indices (operations for determining the reading grade 
level required to read and understand a passage) are widely available. 
Typically, these readability indices have been developed on and for 
general reading material, such as newspapers and magazines, and for the 
non-technical reading material used in the elementary and secondary 
school systems. Moreover they have generally been normed or calibrated 
on the K-12 school population. 

This led us to question the sultablUty of general readability 
indices for ova* purposea on 2 grounds; 

1. The characteristically distinct style, format, and heavy use 
of technical nomenclature in Job technical manuals; 

2. The adult, employed, predominantly male, status of our reader- 
ship. 

An additional problem arises because some of the general readability 
indices require granmatlcal or linguistic competence on the part of the 
user, or the use of special word lists', tables, or equipment which are 
not likely to be routinely and generally available in many cases. 

PROCEDURE 

For the above reasons we undertook to develop a readability Index 
which would b«: (1) davmlopad on assantial Job rsading matsrlalt 
(2) normed for tha young adult mmU population, and (3) slmpla and rssdlly 
•pplicabla by clerical paraeanal without aptelal training or aqulpMnt. 
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Our procedure to develop the FORCAST readability Index consisted 



^' ^ctcmtnc .iobo to be inoluded: We selected 7 Jobs which were 
heavily populated and which covered a wide range of occupational areas. 

2- ^etewwtne eeeential .-job reading maternjilR: For each of these 
Jobs we selected the prescribed body of reading materials used by men 
to prepare for the annual test which qualifies them as proficient In 
their Job. From this body of material we selected 12 ISO-word passages 
JO Represent the Jobs as evenly as possible and to provldTT^^iiTo?— 



difficulty. 

^' ^.ggggg the 12 reading voB Baaee in teme of etruatural vrovertiea: 
We selected 15 standard structural properties to evaluate for use In the 
readability formula. Including number of sentences. Independent clauses, 
words per sentence, number of one-syllable words, letters per sentence, 
and the like. 

A^eocure reader eomprehene ion of the .iob reading vaseagea,' To 
do this, we tested the ability of 200 men to read and understand each of 
the 12 passages using the cloze procedure, in which every n'^ word Is 
deleted and the subject Is required to flll-ln the missing word. This 
procedure is highly correlated with multiple-choice comprehension testing, 
yet has the advantage of being completely non- Judgmental and reproducible, 
^' ggg^e paeeagee in tem e of the reading grade level (RGL) required 
to achieve a eomprehe neion criterion level of 35% oorreot : To scale a 
passage for RGL. we used a version of the general reading ability of the 
200 iren who read the passage, then we determined the lowest RGL at which 
50Z of the men scored 35Z correct on the job reading cloze test for the 
passage (a cloze score of 35Z is roughly equivalent to 70Z correct on a 
multiple-choice test. This criterion lever is a standard, though 
arbitrary, criterion.) 

^' Calculate the regreee ion equation beet predicting the eaaled 
RGL of poeeaaee from t he etruatural propertiee of the oaaaaaamt ^ Exomina- 
tlon of the intercorrelatlons of the 15 structural properties of passagts, 
singly and in various combinations, with doit scoras indicattd that 
one factor — niimber of one-syllable words per 150-4rord passage ~ was 
as eff active as any factor, and was certainly the easiest to apply. 



Based on the foregoing analyses, we calculated the correlations 

between one-syllable words and the RGL associated with the criterion doze 

score performance. This correlation was +.87. Regression analysis 

produced the following preliminary readability formula for 150-word passages: 

RGL - 20.43 - (.11) (number of one-syllable words In a 150-word passage) 

In the Interest of simplicity, and at a small cost In accuracy. 20.43 

and .11 were reduced to 20 and .10. and .10 w.. changed to 1/10. producing 

the very simple readability formula dubbed FORCAST (|ORd, CAylor. STlcht). 

The FORCAST formula for a 15 0-word p aaaage js; 

RGI* ■ 20 - Number of 1-syllable words ' ~ ~ 

10 ' — 

To use the FORCAST formula to predict the RGL of « ISO^rd va^^nna 

one: 

1. Counts the number of one-syllable words in the 150-word passage. 

2. Divides that number by 10. and 

3. Subtracts that value from 20. 

For example, the estimated RGL of readability of a 150-word passage 
containing 96 one-syllable wrods would be 20 - (96/10) - 20 - 9.6 - 10.4 
or about the middle of the tenth grade. This corresponds to the predlc-' 
tlon that, on the average, men reading at the grade 10.4 level would be 
expected to get 35Z correct on a cloze test with every 5*=^ word deleted 
for the passage under consideration. 

RESULTS 

Table 1 summarizes the data for the sample from which the FORCAST 
Index was derived. For comparison purposes, the widely used Flesch and 
Dale-Chall general readability Indices were also applied to the experimental 
passages. The Intercorrelatlons (In the .90s) among these 3 Indices 
Indicate that they are all ordering the passages In highly similar fashion. 
Similarly the 3 indices seem about equally and highly related to the 
criterion of Scaled RGL. Since our basic regression equation was 
derived from these data, the mean of its estimates would necessarily 
equal the scaled RGL mean of 9.9. The effects of rounding off the 2 
decimal place precision of this regression equation to the simplified 
FORCAST formula is shown In tht Man FORCAST estimate of 10.6. For 
the Flesch and DaU-chall Indleaa, hotmvat, thla eotiatltutaa an 
Indapandant validation study. Thaaa two general purpoaa raadablllty 



Indices both overestimate the mean criterion readability for 

these passages by more than 1-1/2 years and their standard deviations 

are higher than that of the criterion measure by a similar amount. 

A cross-validation study was then conducted, using a new sample of 
passages and a new sample of Ss to generate the Scaled RGL for the new 
passages. 

___^rable^ the cross-validation data. Again, the 3 Indices 

^»it^^^^«grgprirfgfai^ The FORC AS T validit y-coefficient has shrunk to 
.77. about that of the Flesch and both somewhat lower than the Dale-Chall. 
The mean readability estimates of the 3 Indices are all about the same — 
and they here underestimate the Scaled RGL by 1 year. The standard 
deviation of the FORCAST estimates closely approximates that of the criterion 
while those of the general purpose Indices are almost twice as large. 

Cross-validation of the FORCAST confirms Its validity for Its 
Intended purpose of estimating the reading difficulty of Job reading 
materials. It can be readily applied by clerical personnel without extensive 
training or special equipment. Moreover, through avoiding extreme values. 
It yields estimates realistically useful for matching the reading ability' 
of Job Incumbent, with the reading ability demanded by printed Job materials. 

LIMITATIONS 

The FORCAST formula was developed for and on a defined body of 
reading material (Army technical Job reading matter) and a defined 
population of readers (young male soldiers). Unlike most ceneral-purpose 
readability formulas. It was not Intended for use with elementary and 
•econdary school mafrlal.. or with nawspaf^.r and magatlnat, and let 
applicability to thasa it not damonatratad. 
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One apparent limitation to the FORCAST index is its restricted range. 
In the unlikely limiting case that all words in a 150-word passage of Job 
material should be monosyllabic, the readability of the passage would be 
indexed as fifth grade (5.0) and the index will go no lower. To date, 
no passages of such low readability have been encountered in Army Job 
material and a diligent search was necessary to turn up a passage at low 
as the 6.0 sc aled reading grade level passage used in the^experimental 
- Ii6u. Ac cne otnernwctrerae, the fact that a maximum score on^r^wci] 
reading test used in this study was normed as RGL 12.9 set this as the 
upper limit that could be assigned to the readability of a passage m 
developing the FORCAST formula. FORCAST predictions above that point 
are based upon linear extrapolation. However, any reading measure 
appropriate to the wide range of soldiers' reading ability must similarly 
be based upon extrapolation at both extremes. Any passage characterized 
as the 12th grade readability is a difficult one, and thera is little nead 
in practical application for precision beyond the slmpl* ordering of 
even more difficult passages. 
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FORCAST Index 

RGL^ - 20 - Number of l-svllable wordu 
* \ 10 

* for a ISO-word passage. 



Table 1 

Development of the FORCAST Formula: Means and 
Intercorrelatlons of Four Indexes of Passage Difficulty 



Index 


Intercorrelatlori 


Mean. 


.-SD 


1 


2 


3 


4 


1. 


FORCAST 




.92 


.94 


.87 


(10.6) 


(1.9) 


2. 


Flesch 


.92 




.97 


.92 


11.8 


4.4 


3. 


Dale-Chall 


.94 


.97 




.93 


11.6 


3.9 


4. 


Scaled R6L 


.87 


.92 


.93 


mm 


9.9 


2.5 



Tabic 2 

Cross-Valldatlon of the FORCAST Formula: Means and 
Intercorrelatlons Among Four Indexes of Passage Difficulty 



Index 


Intercorrelatlon 


Mean 




1 


2 


1 ^ 1 


4 • 


SD 


1. 


FORCAST 




.98 


.95 


.77 


9.4 


2.0 


2. 


Flesch 


.98 




.94 


.78 


9.4 


4.2 


3. 


Dale-Chall 


.95 


.94 




.86 


9.5 


4.0 


4. 


Scaled RGL 


.77 


.78 


.86 




10.4 


2.2 
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Footnote 



The research reported In this paper was performed at the Human 
Resources Research Organization, Division No. 3, Presidio of 
Monterey, California under contract with the Department of the Aniy; 
the contents of this paper do not necessarily reflact official opinions 
or policies of the Department of the Army. 

JLi^}:ij^ortoijhU research is contained in: Caylor, John 8. , 
Sticht, Thomas G. ,~f6xrT^n"C:, and Ford, J. Patri^ - H^thodologU^ 
for Detexmining Beading Requirmwitt of Militeay Ooaupational 
SpeoialtUe^ RumRRO Technical Report (in press). 



